Interface and Infrastructure Design for Ubiquitous Pen- based Interaction on Paper

One of the goals of ubiquitous computing is to allow users to naturally access various digital functions with daily physical artifacts like paper. Existing paper-digital integration systems, however, either sacrifice inherent paper flexibility or support very limited digital functionality on paper. This thesis explores how to enable rich pen-based interaction on paper without loss of the original pen-paper affordances. Such interaction paradigm imposes design challenges on the interface and infrastructure, such as weak visual feedback and varying computing resources available to mobile users. I study a) Supporting techniques and design principles, for instance, combining physical engagement, ink and pen-top multimodal feedback for digital operations on paper; b) Applications of the techniques in areas such as document reviewing, note-taking and 3D modeling to demonstrate the feasibility and usability, and to glean insights for more general use scenarios.